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(54) Colour image sensor with hexagonal shaped pixels 



(57) A colour image sensor has an image array (1 0) 
in which a pixel of a given colour (R,G,B) is surrounded 
by pixels of other colours in a quasi-hexagonal manner. 
Colour values for a given pixel are derived from the ac- 
tual value of that pixel's colour and average values of 
the neighbouring pixels of other colours. These values 



are derived by reading pixel values from three adjacent 
lines into three channels (12,14,16) each comprising de- 
lay lines (20,22,34,36) as temporary storage means, the 
averaging being performed by summing (24,28) the rel- 
evant data from the channels (12,14,16). Bayer-type 
pattems and four colour patterns of pixels are also de- 
scribed. 
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Description 

[0001] This invention relates to a method and appa- 
ratus for processing Images derived from a solid state, 
colour image sensor. 

[0002] It is conventional to derive images from an im- 
age sensor having an image plane In the f omri of an array 
of colour-specific pixels. The colours are typically red, 
green and blue (RGB) and the following description will 
refer to the colours as RGB, but other sets of primary 
colours may in principle be used; for example, it is also 
known to use magenta-cyan -yellow-green. Typically, 
each pixel has a photodiode and associated circuitry, 
with the photosensitive part being overiaid by a colour 
filter layer. 

[0003] The quality of reproduction from such an image 
sensor has limitations, since each pixel detects only a 
single colour. To mitigate this, it is known to process the 
signals in such a manner as to estimate for a pixel of a 
given colour the value of the other two colour compo- 
nents at that location. This is done by manipulating the 
detected values of the other two colours at adjacent pix- 
els: see for example US Patent 4,837,614. However, 
known methods of doing this are cumbersome and re- 
quire a relatively large amount of hardware or process- 
ing power. 

[0004] It is also known to use the so-called Bayer ar- 
rangement in which green pixels predominate, typically 
having rows of alternately green and blue pixels inter- 
leaved with rows of alternately green and red pixels. 
This compensates for the relatively poor response to 
green in typk^l solid state sensors, but signal process- 
ing is still required to estimate RGB values for all pixels. 
[0005] A further limitation on the image quality derived 
from known image sensors arises from the fact that the 
pixels are arranged in a rectangular array. A more effi- 
cient arrangement would be to provide an image plane 
composed of hexagonal pixels: see for example US Pat- 
ent 4,441, 123. However, to date it has notbeen possible 
to achieve a practicable means of fabricating an array 
of hexagonal pixels without unacceptably large gaps be- 
tween pixels or uneconomk: fabrication steps. 
[0006] The present invention provides a method of 
deriving video information from an image sensor having 
an image plane divided into pixels sensitive to different 
ones of a set of colours, the method comprising deriving 
colour values for a given pixel by taking the actual value 
of the colour signal for that pixel and the average value 
of each of the other colours in said set from pixels hex- 
agonaily sunrounding the given pixel. 
[0007] From another aspect, the invention provides a 
solid state image sensor having an image plane fomning 
an array of pixels each of which is sensitive to one of a 
set of colours, in which the pixels are so arranged that 
a given pixel is hexagonal ly surrounded by six pixels 
whteh include at least one pixel sensitive to each of the 
other colours in the set. 

[0008] A further aspect of the invention resides in an 



image sensor apparatus comprising a solid state image 
sensor having an image plane fomning an array of pixels 
each of which is sensitive to a given colour from a set 
of colours, and a circuit for reading out pixel values, said 

5 circuit comprising a plurality of output channels for re- 
ceiving successive pixel values from each of adjacent 
lines of the array, each channel comprising a plurality of 
delay lines whereby a plurality of pixel values are avail- 
able in each channel, and summing circuits each of 

10 which is arranged to sum the values of one colour of 
pixels immediately adjacent a given pixel. 
The image sensor is preferably as defined in the pre- 
ceding paragraph. 

[0009] Other prefen-ed features of the present inven- 
'5 tion are defined in the claims. 

[0010] Embodiments of the invention will now be de- 
scribed, by way of example only, with reference to the 
drawings, in which: 

20 Figure 1 shows an idealised layout of RGB pixels 
for use In one embodiment of the present invention; 
Figure 2 is a similar pixel layout for a four colour 
system; 

Figures shows a layout equivalent to Figure 1 using 
25 physfcal pixels which can be achieved in practice; 
Figures 4A and 4B illustrate the geometry of hex- 
agonal and rectangular arrays, respectively, in 
greater detail; 

Figure 5 Is a schematic block diagram of a camera 
30 using the array of Figure 3; 

Figure 6 shows time charts for two steps in use of 
the circuit of Figure 5; 

[0011] Referring to Figures 1 to 6, the ideal arrange- 
as ment of pixels for use in the present invention would be 
an hexagonal array with adjacent pixels touching, and 
with the colourfitters arranged in such a way that a pixel 
of a given colour is su mounded by pixels of other col- 
ours. Figure 1 shows this for an RGB system, each red 
40 pixel being surrounded by three blue and three green 
pixels, and con^espondingly for the other colours. Figure 
2 shows a four-colour system, in whfch each pixel of col- 
our 1 is sun^ounded by two pixels of colour 2, two of col- 
our 3 and two of colour 4, and correspondingly for the 
45 other colours. 

[0012] Hexagonal pixel an^ys of this nature are diffi- 
cult if not impossible to achieve in practice, whereas the 
fabrication of rectangular pixels is well understood. Fig- 
ure 3 illustrates the manner in which a pseudo-hexago- 
so nal array can be fomied from rectangular pixels. 

[0013] Figure 4 shows in greater detail the optimum 
proportions of the pixels in the array of Figure 3. In a 
hexagonal array (Figure 4A), the centre of any pixel is 
spaced from the centre of each of its neighbours by a 
55 distance d. The optimum form of the rectangular equiv- 
alent (Figure 4B) is to have the centre of area of any 
given pixel spaced from the centre of area of each neigh- 
bour by a constant distance d. Geometrically, this infers 
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that each pixel has a length d and a height d^0.5V3, or 
0.866d. 

[0014] Turning to Figure 5, a photosensor array 10 of 
the form shown In Figure 3 and Figure 4B is connected 
such that three rows at a time are read out to three chan- 
nels 12, 14 and 1 6, the columns being advanced simul- 
taneously under the control of a common dock pulse. 
[0015] The first and third channels 12 and 16 each 
comprise a buffer 1 8 and two delay lines 20 and 22. The 
outputs of the delay lines 20 are taken to a first summer 
24 via respective buffer amplifiers 26 with an amplifica- 
tion factor of unity. The outputs of the delay lines 22 are 
taken to a second summer 28 via respective buffer am- 
plifiers 30 with an amplification factor of unity. 
[0016] The centre channel 14 comprises a buffer 32 
and two delay lines 34 and 36. The output of the buffer 
32 is taken to the second summer 28 via a buffer ampll- 
fier38 with an amplification factor of unity, and the output 
of the second delay line 36 Is taken to the first summer 
24 via a buffer amplifier 40 with an amplification factor 
of unity. The output of the first delay line 34 of channel 
14 is passed via a buffer amplifier 42 with an amplifica- 
tion factor of 3 to an output 44. 
[0017] The summers 24 and 28 provide the sum of 
their input signals to outputs 46 and 48 respectively. 
[0018] Each of the delay lines 20, 22, 34, 36 has a 
delay of one clock pulse. Thus the output lines from each 
channel will give the values of successive pixels. In Fig. 
5 this is shown by the symbols R, G and B at relevant 
points. For the point in time shown, the output at 44 is 
the value of the red pixel 101 in the array 1 0, multiplied 
by 3. The output of the first summer at 46 is the sum of 
the three green pixels 1 02, 1 03, 1 04. The output of the 
second summer 28 is the sum of the three blue pixels 
105, 106, 107. 

[0019] The outputs 44, 46, 48 at this time therefore 
define the RGB values of the pixel 101 in temos of the 
actual red value and the mean of the surrounding green 
and blue values, all times 3. At the next clock pulse, the 
interpolated red 46 and green 48 values co-sited with 
the blue value 44 con^esponding to pixel 1 06 in array 1 0 
will be output in similar fashion. 
[0020] Figure 6 illustrates the timing of this process. 
[0021 ] Reverting to Figure 5, a switch matrix 50 is pro- 
vided by which the output 44, 46, 48 are cyclically con- 
nected to green, red and blue output lines 52, 54, 56 
respectively. 

[0022] The camera of Figure 5 contains further circuit- 
ry to modify the raw RGB output on the lines 52 - 56. 
[0023] The signals are first passed through a dynamic 
colour compensation matrix 58. The narrow bandwidth 
colour filters used on the individual pixels do not permit 
perfect colour reconstruction as far as the eye is con- 
cerned. The compensation matrix 58 operates to mini- 
mise the colour en-ors. The processing is dynamic to off- 
set the effects of changing lighting. 
[0024] The signals next pass through an equalizer 60. 
Up until now, the images processed have been largely 



low-pass filtered. The equalizer 60 is used to improve 
the high frequency content of the images. 
[0025] The next stage is a phase shifter 62. Because 
of the staggered layout of the pixels in the array 1 0, each 
5 line read in from the an^y has a physical horizontal off- 
set, relative to the preceding and succeeding lines, of 
+/-(Ph/2) where Ph Is the horizontal pixel pitch. In the 
example of Figure 5, the red pixel 1 01 is physically offset 
from the blue pixels 1 05 above and 1 07 below by -Phy2. 
[0026] The phase shifter 62 accomplishes sampling- 
structure conversion from hexagonal to rectangular by 
adjusting the group delay of an a II pass filter, shifting al- 
temating lines by +/-(Ph/4). In the example of Figure 5, 
the interpolated blue pixel 48 is phase-shifted by +Ph/ 
4.As the lines above and below are phase-shifted by 
-Ph/4, the relative physical offset of -Ph/2 is removed 
and alignment is achieved. 

[0027] This rectangularty-structured RGB is then con- 
verted by an encoder 64, for example an ITU-656 en- 
coder, to give a final output in a form suitable for viewing 
on standard monitors. 

[0028] Figures 7 to ** illustrate another embodiment 
of the Invention applied to a Bayer-type pattern. Figures 
7A, 7B and 7C show three possible ways of applying a 
Bayer-type pattern to a hexagonal array. In each of 
these, as in the normal rectangular Bayer pattern, the 
number of green pixels is twk^ that of red pixels, and 
the number of green pixels is twice that of blue pixels. 
[0029] As before, it is not practicable to fabricate a 
hexagonal pixel an^ay, and a rectangular analogue is 
used. Figure 8 shows the pattem of Figure 7A altered 
to rectangular fonn, and again the optimum height: 
length ration of 0.866 is used. It will be readily apparent 
that the patterns of Figures 7B and 7C could be altered 
to equivalent rectangular forms. 
[0030] Figure 9 illustrates the principle of reconstruct- 
ing colour information from the an^ay of Figure 8. For 
each pixel where no information is present in a given 
colour, the information is estimated by interpolation from 
the neighbours which detect that colour; this is indicated 
by arrows in Figure 9. 

The interpolation will typically be done by summing and 
averaging the neighbouring values. 
[0031] As in the first embodiment, in order to obtain a 
standard signal fonnat, it is then necessary to shift al- 
ternate rows by +/-(Ph/4) to obtain a rectangular anray 
fonnat, following which equalisation and colour connec- 
tion may be applied in known fashion. 
[0032] In the embodiment of Figures 7 to 9, the inter- 
polation may be implemented by a system of delay lines 
and summers similar to that of the first embodiment, as 
will be apparent to those in the art without detailed de- 
scription. 

[0033] The invention thus provides an image sensor 
and camera which provide the advantages of a hexag- 
onal pixel array in a simple and practicable manner 
[0034] Modifications may be made to the foregoing 
within the scope of the invention. 
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Claims 

1 . A method of deriving video infomriation from an im- 
age sensor having an image plane divided into pix- 
els sensitive to different ones of a set of colours, the 
method comprising deriving colour values for a giv- 
en pixel by taking the actual value of the colour sig- 
nal for that pixel and the average value of each of 
the other colours in said set from pixels hexagonally 
surrounding the given pixel. 

2. A method according to claim 1 , in which said aver- 
age values are derived by reading out pixel values 
simultaneously from a plurality of lines, storing suc- 
cessive values for each line, and adding stored val- 
ues of the same colour from adjacent lines. 

3. A method according to claim 1 or claim 2, in which 
equal numbers of pixels are sensitive to each of the 
set of colours. 



1 0. Apparatus according to dalm 9, in which said image 
sensor is in accordance with any of claims 6 to 8. 

11 . Apparatus according to claim 9 or claim 1 0, further 
5 including a matrix switch arranged to cyclically con- 
nect each channel to successive ones of a set of 
colour output lines, one for each colour of the set. 

12. Apparatus according to claim 11 , in which the sig- 
10 nals on said colour output lines are processed by 

one or more of dynamic colour compensation, fre- 
quency equalization, and encoding into a standard 
video fomnat. 

IS 13. Apparatus according to claim 11 when dependent 
on claim 7, in which the signals on said colour output 
lines are subjected to phase shifting to produce a 
rectangular row and column fomnat. 

20 



4. A method according to claim 1 or claim 2, in which 
the set of colours is red, green and blue, and in 
which the number of pixels sensitive to green is 
twice the number of pixels sensitive to each of red 25 
and blue. 



5. A method according to any preceding claim, in 
which alternate lines of output colour signals are 
phase shifted relative to each other to define a rec- 30 
tangular row and column fomnat. 



6. A solid state image sensor having an image plane 
fonning an array of pixels each of which is sensitive 
to one of a set of colours, in which the pixels are so 35 
arranged that a given pixel is hexagonally surround- 
ed by six pixels which include at least one pixel sen- 
sitive to each of the other colours in the set. 



7. An image sensor according to claim 6, in which the 40 
pixels are rectangular and are laterally displaced in 
successive rows by one-half of the rectangle length. 

8. An image sensor according to claim 4, in which 
each pixel has a length d and a height of d*0.5»3. 45 

9. An image sensor apparatus comprising a solid state 
image sensor having an image plane fomning an ar- 
ray of pixels each of which is sensitive to a given 
colour from a set of colours, and a circuit for reading so 
out pixel values, said circuit comprising a plurality 

of output channels for receiving successive pixel 
values from each of adjacent lines of the an-ay, each 
channel comprising a plurality of delay lines where- 
by a plurality of pixel values are available in each 55 
channel, and summing circuits each of which is ar- 
ranged to sum the values of one colour of pixels im- 
mediately adjacent a given pixel. 
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